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Washington, D,C. 20231 



Sir: 



Applicant respectfully submits this preliminary amendment in response to the 
Notice to File Missing Parts dated May 17, 2001. A Petition for a Five Month Extension of 
Time is enclosed herewith. 

AMENDMENT 

Please amend the above identified application as follows: 
In The Specification: 

Please make the following amendments to page 8, line 1 through page 10, line 4: 

[Fig. 6 is a diagram illustrating an example of a run- 
time coordination algorithm according to the present 
invention; ] 

Fig. 6. [7] A is a graph illustrating the performance index 
of a system according to the present invention as a function 
of the frame number, which corresponds to the elapsed time. 
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and Fig. 6 [7]B is a graph illustrating the number of local 
interactions in the system according to the present invention 
as a function of the frame number, which corresponds to the 
elapsed time; 

[Fig. 8 is a diagram illustrating an example of an 
algorithm of a version optimized in terms of a block diagonal 
system; ] 

Fig, 7. [9] is a table illustrating the evaluation 
results in terms of the stability and the calculation load 
during a game, for the algorithm according to the present 
invention; 

Fig. 8. [10] is a schematic diagram illustrating one 
scene of an animation of a group of bees produced according 
to the present invention; 

Fig. 9 [11] illustrates examples of matrices used to 
generate the animation shown in Fig. 8. [10] ; 

Fig. lOA [12A] is a graph illustrating the evaluation 
function (optimal cost) for another example of an animation 
as a function of the frame number, and Fig. lOB [12B] is a 
timing chart illustrating the changes in the state space in 
terms of the roles assigned to six airplanes contained in an 
formation of airplanes used in the example shown in Fig. lOA 
[12 A] ; 

Fig. IIA [13A] is a graph illustrating the performance 
index associated with another example of an animation 
according to the present invention as a function of the frame 
number, and Fig. IIB [13B] is a timing chart illustrating the 
changes in the state space in terms of the roles assigned to 
six fishes contained in a group used in the example shown in 
Fig. IIA [13A] ; 

[Fig. 14 is a schematic diagram illustrating an example 
of an off-line algorithm for calculating parameters 
associated with a coordination process according to the 
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present invention; ] 

[Fig. 15 is a schematic diagram illustrating another 
example of an off-line algorithm for calculating parameters 
associated with a coordination process according to the 
present invention; ] 

Fig- 12 [16] is a functional block diagram of an 
entertainment apparatus using a control method according to 
the present invention; 

Fig. 13 [17] is a schematic diagram illustrating an 
example of the hardware configuration of an entertainment 
apparatus using the control method according to the present 
invent ion ; and 

Fig. 14 [18] is a circuit diagram illustrating an 
i;0 example of a circuit configuration of the entertainment 

{1^ apparatus using the control method according to the present 

invention. 

Please make the following amendments to page 34, lines 1-19: 

|!3 

An example of a novel algorithm for achieving 
coordination at run time according to the present invention 
is shown below [in Fig. 6] . This example of the algorithm 
[shown in Fig. 6] has a high responsiveness and may be 
performed in real time. Furthermore, at the design stage, 
the optimum feedback rule is determined from the 
characteristics of the dynamic system according to the 
evaluation criteria using an off-line algorithm including a 
procedure widely used to solve the LQ problem. This will be 
discussed in further detail later in Section (A-8) . 

RUN-TIME COORDINATION ALGORITHM (Al) 
Exert Continuous Multivariable Controls 
(Role Assignments Defined by Tir.) 



3 



Attorney Docket No.: 444.26.01 PATENT 

Dynamic Simulation Step 

2, ^ f (X^, U^) 

3, J <r (X.-7r..X ^)^S (X^-TC^.X^:^) 

Sort Entities According to their Contribution to Ove rall Cost 

4, For each entity i do 

■R. X^-^ ^ ^X.^X.^ i^^ coordinate of (ti.X..^) X. ^] 

7 . Endf or 

8. Sort entities bv decreasing J-^ Cn) 

Look for Opportunistic Role Swaps in K Worst Performers 

9. For Ki permutations tt (k) of K candidates do 

10. J _(7i(k)) <r (X.-7i(k) .X^ )^S _(X^-7i(k) .X^) 

11. if iJ _ * > |J^(7r(k))+An^|) then 

12. J J <r J_(7i(k)) 

13. k* -e- k 

14. endif 

15. endf or 

Update Role Assignments Switchboard 

16. TZr.^^ 4- 7t(k)* 



1. Feed-forward gains (or integral terms) ensure disturbance 
rejection. 

2. Threshold prevents flickering due to non-linear dynamics. 

3. Permutations are computed beforehand (see offline 
algorithm in Section (A-8)). 

4. Role assignment is represented by matrix fT for 
convenience, yet implementation relies on a simple 
indirection rather than matrix multiplication. 



The algorithm shown above [in Fig. 6] is applied for 
each time step. The calculation efficiency of the algorithm 
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may be increased by various methods including a clustering 
technique used in a simulation of a many-body (n-body) 
problem or a method adapted to characteristics intrinsic to a 
particular case. Although a matrix representation is 
employed, the matrix representation is not always efficient . 

Please make the following amendments to page 38, line 6 through page 39, line 22: 

Although Liapunov's method can be applied to nonlinear 
dynamics, the execution thereof is complicated and it is 
necessary to perform a computer simulation to check whether 
the algorithm is trapped. Fig. 6A [7A] is a graph showing 
the performance index, and Fig. SB [7B] is a graph showing 
the number of local interactions. In Fig. 6B [7B] showing 
the number of local interactions, open bars represent the 
number of collisions and solid bars represent the number of 
role replacements. In both Figs. 6A [7A] and 6B [7B] , the 
horizontal axis represents the frame number which corresponds 
to the elapsed time. It can be seen from Figs, 6A [7A] and 
6B [7B] that the number of collisions and the performance 
index both decrease with increasing frame number and with 
increasing number of role replacements. 

(A-5-3) Real-Time Performance 

The algorithm ( Al. above; and A2 , below f Figs. 6 and 8]) 
according to the present invention has been evaluated in 
terms of the stability and the calculation load imposed upon 
a game under the conditions of a frame rate of 50 Hz and a 
peak number of instructions of the order of GFLOPS/sec (Fig. 
2 [9] ) . The algorithm has been executed on the PlayStation 2 
produced by Sony Computer Entertainment, Inc. It has been 
assumed that the CPU time spent for the processing associated 
with the dynamic characteristics and the coordination is very 



hid 
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short (of the order 1% of the total CPU time) , and the number 
of members whose roles were replaced was limited to K = 6 . 
When the number N of members is small, the processing 
associated with the coordination and the processing 
associated with the dynamic characteristic need similar 
calculation loads. However, the processing associated with 
the coordination becomes dominant when N is large. 

The algorithm A2 shown below [in Fig. 8] is an example 
of an algorithm of a version optimized in terms of the block 
diagonal system. The algorithm A2 shown below [in Fig. 8] 
has better linear characteristics than the algorithm Al shown 
in Section (A-5) [Fig. 6] , because the core matrices Soo, A, 
B, and G in the algorithm A2 increase in size linearly as N 
increases, while they increase in size quadratically in the 
algorithm Al , 

OPTIMIZED VERSION FOR BLOCK- DIAGONAL SY STEMS (A2) 



1 , <r -GrX.-7r..X^.f] 

fiyl 3. For 1 = 1 to N do 

4. 8JM_.-i) ^ rx.^^(7t..x. .. ^^rs"""^"^rxJ-(7i..x...)^] 

5 . endf or 

6. Sort entities by decreasing 5J(i,I) & se lect first K ones 

7. for k=l to K do 
8_s for p=k to K do 

Q. sj(k.p) ^ rx^^-x.^^i^s"""^^yrx.^-x...p] 

10 . endf or 

11. endf or 

Look for Opportunistic Role Swaps in K worst perf ormers 

12. For KI permutations 7i;(k) of K candidates do 

13. J_(Tc(k)) <r ^^5J(p, -X^(p.7i(k)) or target (p, 7i(k))) 
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14. if (J _* > I J (Ti(k) )+An.^^l ) then 

15. J _* <r JJn{}^)) 

16. k* k 

17- endif 

18. endfor 

19. 7in..i <- 71 (k*) 

(1) Sorting candidates for role swapping on a simple 
distance-to-tarqet criterion cor responds to replacing Sentity 
by the identity matrix. 

Please make the following amendments to page 41, line 5 through page 42, line 8: 

By way of example, an animation of a group including 50 
members (bees) is described. In this example, the bees in 
the group behave as a group (have linear attraction) , while 
they behave repulsively when they come very close to each 
other (that is, there is nonlinearity and the Newton's law of 
collision holds) . One scene of an animation of the group of 
bees is shown in Fig. 8. [10] . 

In Fig. 8. [10] , 50 bees gather within a particular 
region below light. Although a dynamic model employed herein 
is not a mechanical model employed in many other cases, the 
dynamic model employed allows suppression of acceleration of 
expansion of members. Thus, a certain systematic group 
behavior is described by this dynamic model . 

The system equation is given as Xn+i = AXn + BU^ + (Xn) . 
Matrices such as those illustrated conceptually in Fig. 9 
[11] are required for the calculation according to the 
algorithm Al. In Fig. 1 [11], the matrix G is used to 
provide inputs of members and the matrix S is used to 
determine the cost (performance index) such as a simple 
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distance. In Fig. 9. [11] , non-zero elements in the matrices 
are represented by shaded areas, and zero elements are 
represented by open areas- For a group which includes a 
large number of members, as is the case with the present 
group of beeS/ the calculation load associated with the 
multivariable feedback becomes greater than that of the 
simulation. This can also be seen from comparison between 
the sizes of matrices A and B and the sizes of matrices G and 

Please enter the following amendments to page 42, lines 16-24: 

As shown in Fig. 6. [7] , although the group is collapsed 
at an initial stage, bees gradually gather into a specified 
form after a layout is applied when the frame number = 21. 
In the present example, the number of role replacements is 
limited to 6 for each frame. Because the replacement of 
roles needs a finite period of time, a greater number of 
members of the group can be involved in practice. In spite 
of collisions, the group of bees forms a specified shape. 

Please enter the following amendments to page 43, line 15 through page 44, line 6: 

Fig. lOA [12A] is a graph illustrating the evaluation 
function (optimal cost) for the present example as a f -unction 
of the frame number. Fig. lOB [12B] is a timing chart 
illustrating the changes in the state space in terms of the 
roles assigned to six airplanes contained in the airplane 
formation of the present example. In the present example, 
the control rule is calculated upon the assumption that 
airplanes fly in formation and an operating point is obtained 
near the point at which the Jacobian of the system is 
extracted. The layout is changed at frame number = 100 and 
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also at frame number = 200 thereby triggering the replacement 
of roles among airplanes. 

As can be seen from Fig. 10 [12] , when the nonlinearity 
is not very strong, as is the case in the present example, 
the performance index generally reduces. The threshold value 
is reduced to about 30% in order to avoid flicker and 
sporadic replacement of roles . 

Please enter the following amendments to page 44, line 26 through page 45, line 17: 

The nonlinearities cause the state-space trajectories of 
fishes of the group to become complicated, as shown in Fig. 
11 [13] , and the algorithm functions in a manner which is 
very different from the predicted manner. 

Fig. IIA [13A] illustrates the performance index in the 
present example as a function of the frame number. Fig. IIB 
[13B] is a timing chart illustrating the changes in the state 
space in terms of the roles assigned to six fishes contained 
in the group in the present example, wherein lines represent 
respective fishes and the vertical coordinate represents 
targets. When there is strong nonlinearity as is the case in 
the present example, the performance index decreases in a 
random fashion. For example, replacement of roles is 
triggered by a change in the layout at frame number = 3 00. 
Spontaneous replacement of roles occurs near frame number = 
200. 

Please enter the following amendments to page 50, lines 6-19: 

At the design stage, the coordination method is 
described by parameters using a matrix obtained by two off- 
line algorithms. A first algorithm ( ^^Multivariable LQ 
Control Synthesis", below [Fig. 14]) calculates the 
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multivariable optimum feedback on the basis of eigenvector 
expansion and solves the ARE (standard algorithm in LQ 
synthesis) 

MULTIVARIABLE LP CONTROL SYSTHESIS 

1. Given the dynamic system A, B and performance index 
matrices O, R, form the Hamiltonian matrix defined as: 



2, Complete eigenvalues X and eigenvectors W of H, collecting 
all couples such that the eigenvalue's modulus is smaller 
than one (stable pole of the closed- loop system) 

3 . Compute S_=XW^ 

A. Compute the optimal matrix K Gain as 



The second off-line algorithm ( Function 
PermutationArray=Permute (vector) " , below [Fig, 15]) 
recursively generates K! permutations and stores them in 
advance. These calculation results are sequentially used at 
run time to evaluate the role replacement. When K = 7, the 
number of entries of the table becomes 4,320. The 
permutation algorithm is described in R, Grimaldi, "Discrete 
an Combinational Mathematics", Addison-Wesley, New York, 
1999. 

Function PermutationArray=Permute (vector) 
1 . n=length (vector) 



H = 



B+AR"^B'^A''^Q 
-A"^Q 




G = rR+B^S_Bl '^B^S^ A 
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2. if(n==l) then 

3 . Permut at iQnArray= vector 

4- else 

5 . Permut a tionArray=NULL array 

6_, Height = 0 

7 . for k=l to n do 

8 . sub-vector (k) =ShrinkVectQr (vector , k) 

9 . SubArray=Permute (sub-vector) 

10. for i=l to (n-1) 1 do 

11 . for 1=1 to n-1 do 

12 . PermutationArray ri+Heiaht1 f j 1 -SubArray Til fjl 

13 . endf or 

14 . PermutationArray [i+Heiahtl \n] =vector [k1 

15 . endf or 

16. Heiqht=Height+ (n+1) 1 

17 . endf or 

18. endif 

19. return PermutationArray 



Please enter the following amendments to page 51, lines 1-7: 

Fig, 12 [16] illustrates, in functional block diagram 
form, main parts of the entertainment apparatus of the 
present embodiment , 

In Fig. 12 [16] , reference numeral 101 denotes control 
means used by a game player to input various commands. 
Command data input via the control means 101 is transmitted 
to game executing means 102. 

Please enter the following amendments from page 53, line 1 through page 54, line 23: 

An example of the appearance and an example of the 
general hardware configuration of the entertainment apparatus 
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of the present embodiment are described below with reference 
to Figs. 13. [17] and 14 [18] . 

Fig. 13 [17] illustrates an example of the appearance of 
the entertainment apparatus. The entertainment apparatus 1 
reads a game program stored on an optical dislc such as a CD- 
ROM and executes it in response to an operation performed by 
a game player. 

The main unit 2 of the entertainment apparatus 1 
includes a dislc loading part 3 in which an optical dislc on 
which a game program is stored is loaded, a reset switch 4 
for resetting the game, a power switch 5, a disk control 
switch 6 for controlling the loading of the optical dislc, and 
slots 7A and 7B (two slots in this specific example) . 

The slots 7A and 7B are used to connect a controller 20. 
The slots 7A and 7B may also be used to connect a memory card 
so that game data is stored to or read from it. 

The entertainment apparatus 1 is connected to a monitor 
3 0 and loudspeakers 40, although connecting parts are not 
shown in Fig. 13. [17] . In the example shown in Fig. 13 [17] , 
a television set is used as the monitor 3 0 and also as the 
loudspeakers 4 0 . 

Fig. 14 [18] illustrates the general hardware 
configuration of the entertainment apparatus 1. As shown in 
Fig- 14. [18] , the entertainment apparatus 1 includes a 
control system 50 including a CPU 51 and associated 
peripheral devices, a graphic system 60 including a GPU 62 
which writes an image into a frame buffer 63, a sound system 
70 including an SPU (sound processing unit) 71 for producing 
musical sounds or sound effects, an optical disk control 
system 80 for controlling the optical disk on which the game 
program is stored, and a communication control system 90 for 
controlling the inputting of a signal output by the 
controller 20 in response to a command given by a game player 
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and also for controlling the inputting/outputting of data 
to/from a memory card 10 in which settings of the game or the 
like are stored. 

In Pig. 14 [18] , the control system 50 includes the CPU 
51, a peripheral device controller 52 for controlling 
interrupt handling and direct memory access transfer 
operations, a random access memory (RAM) serving as a main 
memory 53, and a read only memoary (ROM) 54 in which is stored 
an operating system (OS) for controlling various parts such 
as the main memory 53, the graphic system 60, and the sound 
system 70. 

Please enter the following amendments to page 55, lines 13-19: 

In Fig. 14. [18] , the graphic system 60 includes a GTE 
(geometry transfer engine) 61 for performing a process such 
as a coordinate conversion, a GPU 62 for writing an image in 
accordance with an image write command given by the CPU 51, a 
frame buffer 63 for storing the image written by the GPU 62, 
and an image decoder 64 for decoding image data coded in a 
compressed fashion. 

Please enter the following amendments to page 56, line 23 through page 57, line 22: 

In Fig. 14 [18] , the sound system 70 includes the SPU 71 
for producing sounds such as musical sounds or sound effects 
in accordance with a command given by the CPU 51, and also 
includes a sound buffer 72 used by the SPU 71 to store 
wavefo3rm data. The musical sounds or sound effects produced 
by the SPU 71 is output to the loudspeakers 40. The SPU 72 
further has the capability of decoding audio data and also 
the capability of reproducing, directly or after modulating, 
waveform data. 



13 



Attorney Docket No.: 444.26.01 PATENT 

In Fig. 14 [18] , the optical disk control system 80 
includes an optical disk drive 81 for reading the game 
program or data stored on the optical disk, a decoder 82 for 
decoding the game program or the data, and a buffer 83 for 
temporarily storing data read by the optical disk drive 81 
thereby allowing data to be read from the optical disk at a 
higher speed. 

Furthermore, in Fig, 14 [18] , the communication control 
system 90 includes a communication controller 91 for 
controlling the communication with the CPU 51 via a bus. The 
communication controller 91 includes a controller connecting 
part 9 for the connection with the controller 20 used by a 
user to input a command and also includes a memory card 
insertion part 8 for the connection with the memory card 10 
for storing the game settings data or the like. 



REIMARKS 



Please amend the specification to reflect the change in the numbering scheme for the 
drawings, which was required by the Notice to File IVIissing Parts. Figures 6, 8, 14 and 15, 
as filed have been deleted and their contents have been moved into the specification. The 
remaining figures have been sequentially renumbered and the specification has been 
amended to remove citations to the deleted figures and correct the citations to the 
renumbered figures. Specifically, all references to Figures 7A and 7B have been changed 
to Figures 6 A and 6B, respectively; all references to Figure 9 have been changed to Figure 
7; all references to Figure 10 have been changed to Figure 8; all references to Figure 11 
have been changed to Figures 9; all references to Figures 12A and 12B have been changed 
to Figures lOA and lOB, respectively; all references to Figures 13 A and 13B have been 
changed to Figures llA and IIB, respectively; all references to Figure 16 have been 
changed to Figure 12; all references to Figure 17 have been changed to Figure 13; and all 
references to Figure 18 have been changed to Figure 14. 
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Applicant respectfiilly submits that no new matter has been added to the 
application. Although no amendments were made to the claims, the page numbers of the 
claims have been changed. Because the amendments affect the majority of the pages of the 
application, a clean copy of the entire amended application is submitted. New drawings are 
also submittedwhich have been changed to account for the revised figure numbering. 
Copies of the "Notice To File Missing Parts Of Nonprovisional Application" and "Notice 
Of Incomplete Reply (Nonprovisional)" are also attached. 



The Commissioner is hereby authorized to charge any underpayment of fees 
associated with this communication, including extension of time fees, or credit any 
overpayment to Deposit Account No.04r0822. The applicant respectfully submits that the 
above identified application is in a condition for allowance. 



Respectfully submitted, 
DERGOSITS & NOAH LLP 



Dated: December 13, 2001 



By: 




Paul K. Tomita 
Reg. No. 43,169 



Attorneys for Applicants 
Four Embarcadero Center, Suite 1150 
San Francisco, California 941 11 
(415) 705-6377 

Applicant's Ref No. 444.26.01 
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